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Abstract 

We consider the problem of constructing a thermodynamic theory of non-equilibrium steady 
states as a formal extension of the equilibrium theory. Specifically, studying a particular system, 
we attempt to construct a phenomenological theory describing the interplay between heat and me- 
chanical work that takes place during operations through which the system undergoes transitions 
between non-equilibrium steady states. We find that, in contrast to the case of the equilibrium 
theory, apparently, there exists no systematic way within a phenomenological formulation to de- 
scribe the work done by the system during such operations. With this observation, we conclude 
that the attempt to construct a thermodynamic theory of non-equilibrium steady states in analogy 
to the equilibrium theory has limited prospects for success and that the pursuit of such a theory 
should be directed elsewhere. 
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I. INTRODUCTION 



In this paper, we examine the proposition of constructing a thermodynamic theory of 
non-equilibrium steady states in a form that mimics that of the equilibrium theory. There 
are a number of existing works that formulate various extensions of the equilibrium theory to 



non-equilibrium systems, and some of these formu 
steady states, in particular those in 



ations are applicable to non-equilibrium 
6]. However, none of these works yields 



results of general validity in the case of non-equilibrium steady states, as each is limited to 
either systems close to equilibrium or systems in which the asymptotic states differ from 
equilibrium only trivially [7]. Here, we investigate the prospect for constructing such an 
approach that is of general applicability. 

The theoretical framework of equilibrium thermodynamics is fundamentally a formalism 
for describing the manner in which thermal and mechanical forms of energy are converted 
into one another in processes that connect equilibrium states. In this paper, we consider 
the construction of such a framework for non-equilibrium steady states. More precisely, we 
consider the formulation of a kind of thermodynamic potential in terms of which we can 
understand the interplay between heat and mechanical work in operations connecting non- 
equilibrium steady states, and we attempt to obtain a generalized second law valid for such 
systems. Through this investigation, we reach the conclusion that a theory of this type is of 
quite limited use. 

As we show here, the main difficulty faced in the attempt to construct a thermodynamic 
theory of non-equilibrium steady states similar to the equilibrium theory is that when we 
consider operations in which a system undergoes a transition from one steady state to 
another through the variation of the externally adjustable mechanical parameters (work 
coordinates), the work done by the system cannot be easily characterized. There are two 
particular problems that we encounter in this regard. First, in general, for a quasi-static, 
purely isothermal operation, the work done by the system through the work coordinates as 
it goes from one specific steady state to another is not independent of the path taken among 
these coordinates. Second, for a given path, the amount of work done by the system through 
the work coordinates is not necessarily maximal in the case of a quasi-static operation, and 
there is no apparent way to determine when a quasi-static operation maximizes this work and 
when it does not. From these results, obtained for a particularly simple system, it is surmised 
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that the formulation of a generally useful thermodynamic theory of non-equilibrium steady 
states that describes the conversion of heat into mechanical forms of energy is an extremely 
difficult problem at best. We thus believe that the attempt to construct a phenomenological 
theory of non-equilibrium steady states should be directed elsewhere. This conclusion is 
consistent with the observation that fundamental advances in physics result not from the 
formal extrapolation of existing theories but from the discovery of simple, novel relations 
involving readily measured quantities. 

II. PRELIMINARIES 

In this section we introduce the system studied and present the expressions for a number 
of quantities that are used repeatedly throughout the paper. 

A. The system 

In order to demonstrate the points of this paper in the clearest manner, we consider 
a very simple system, consisting of a single Brownian particle in one spatial dimension. 
Throughout this work, we regard this particle as the 'system' and the fluid medium in 
which it is suspended as a heat bath We study the case in which the dynamics of the 
system can be described by a Langevin equation of the form 

jx(t) =T(x(t)]a{t)) + Z{t) , (1) 

where x denotes the position of the particle, 7 is a friction constant, a(t) is an externally 
variable parameter on which the systematic force T depends, and £ (t) represents a Gaussian 
noise of intensity 27T, with T the temperature of the heat bath (choosing units in which 
the Boltzmann constant is unity). 

Now, we wish to consider the situation in which the deterministic force, jF(x;a), takes 
the form T{x\ a) = F(x; a) + /, where F(x; a) is a conservative force derived from some 
potential V(x;a), and / is a non-conservative force that is uniform in space. In general, 
if a is held fixed, a system of this kind will converge to a non-equilibrium steady state 
characterized by this value of a in the large time limit. 

Applying the stochastic Liouville equation to (pQ), it is found that the dynamics of the 
particle number probability distribution function, p(x,t), are described by the following 
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Smoluchowski equation j9(: 

jp(x, t) = d/dx [Td/dx - F{x; a(t))] p{x, t) . (2) 

Note that the quantity x in this equation and that in ([I]) have different meanings, as here it 
is an independent variable, whose domain is the configuration space. We consider the case 
in which the system is subject to the periodic boundary conditions p(L,t) = p(0,t). 



B. Important quantities 

In this paper, we investigate processes in which a is varied in time. To make the following 
treatments as clear as possible, we now present the important quantities used throughout 
the paper. 

First, at any given position and time, there will be some current in the system, j(x,t), 
representing the rate of particle flow through the point x at time t in the direction of 
increasing x [h]]. In the overdamped case considered here, this quantity is given by 



ox 



p(x,t) , (3) 



where D = T/7 is the diffusion coefficient. We write the spatial average of j(x,t) as j(t). 
(Throughout the paper, we use the overline to represent the spatial average.) From (j3J), we 
immediately obtain 

j = 7~ 1 c / + 7 _1 ^P > (4) 

where cq = L^ 1 . Note that in a steady state, we have j = j. We represent the current in 
this special case by j ss . If the system is not in a steady state, there will generally exist some 
non-uniform current, j non = j — j. 

At any time, the energy of the system, U, is given by U(t) = J dxV(x;a(t))p(x,t). 
(Throughout the paper, all integrals over the spatial coordinate are done over the entire 
system, and thus, for simplicity, we omit the limits of integration.) Next, note that the rate of 
work done by the external agent when changing a, wp(t), is given by a-J^ J dxV(x; a)p{x ) t). 
Then, because p(x, t) is not an explicit function of a and the only time dependence in V is 
that in a, we have 

w F = J dx — p(x,t) . (5) 
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Next, consider the quantity J dxV(x; a)p(x,t). Using the conservation of particle number 
and some simple manipulations, it is readily shown that this is equal to — / dxF(x; a)j(x, t). 
Then, noting the form of F(x; a), obviously, it is also equal to — / dxF(x; a)j non (x, t). This 
quantity represents the opposite of the total rate of work done by means of the force F on 
the Brownian particle. Hence, because we are considering the case in which the motion of 
the particle is overdamped, this must be equal to the rate of work done by the heat bath 
on the non-uniform component of the current. Following Sekimoto [3], we interpret this as 
the rate of transfer of a type of heat, which we write q non . Thus, we have 

<f on = - J dxF{x;a)j{x,t) . (6) 

Combining the above results, we obtain the following: 

f = «"+'-■ < 7 > 

The rate of work done by means of the non-conservative force, Wf, is given by 

w f = Lfi. (8) 
Once again, because the motion of the particles is overdamped, we have 

<Z uni = ~Wf , (9) 

where q nm is the rate of transfer of "uniform heat," which is defined as the rate of work done 
by the heat bath on the uniform component of the current. Because q nm and Wf always 
cancel, they play no direct role in the following analysis. 

We express the time integrals of the quantities wp, Wf, q non and q um over an entire process 
by W F ,W f , Q non and Q uni . 



III. DIRECT GENERALIZATION OF EQUILIBRIUM FORMALISM 
A. Motivation of approach 

The formalism of equilibrium thermodynamics is based on a thermodynamic potential 
that is a state function. Owing to the special properties of equilibrium systems, as em- 
bodied in this thermodynamic potential, the performance of work can be described in a 
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quasi-mechanical manner, because the work done by a system in an infinitesimally slow op- 
eration connecting any two initial and final states is simply given by the difference between 
the values of the thermodynamic potential at these endpoints. Hence, in this case, the 
conversion of heat into mechanical forms of energy can also be described within this quasi- 
mechanical framework, entirely in terms of thermodynamic state variables. The usefulness 
of the formalism based on the thermodynamic potential follows from these properties and 
the fact that, with regard to the conversion of heat into mechanical forms of energy, there 
is a simple relation between the behavior of the system in quasi-static and non-quasi-static 
operations, with the transfer of heat to the system and the performance of work by the 
system always being maximized by the former. 

Noting that non-equilibrium steady states are realized as asymptotic fixed-point solutions 
in the time evolution of a large class of systems, it is natural to conjecture that such states, 
like equilibrium states, correspond to minima of some quantity characterizing the state space, 
i.e., some kind of non-equilibrium thermodynamic potential. It is thus reasonable to seek a 
formalism of non-equilibrium steady states analogous to that of equilibrium states, in which 
a description of the performance of work and the exchange of heat is expressed in terms of 
state variables. In fact, there exist attempts to construct such a formalism j^l, Q, [|], El, but as 
shown in this section, obtaining a general theoretical framework for non-equilibrium steady 
states based on a thermodynamic potential is perhaps unfeasible. 

In the case of non-equilibrium steady states, in contrast to that of equilibrium states, 
even for a quasi-static operation, the total transfer of heat cannot be accounted for within a 



ts in the continual dissipation of work 

"I 

5[ proposed an approach to construct- 



mechanical picture, as the steady state current resu . 
into heat. Recognizing this, Oono and Paniconi 
ing a theory of non-equilibrium steady state systems that begins by subtracting out this 
steadily dissipated heat (what they call the "housekeeping heat"). They conjectured that 
if this is done in the proper manner, the remaining heat (the "extra heat") will play a role 
like that of the total heat in the equilibrium case. If these roles were perfectly analogous, it 
would be possible to define a thermodynamic potential characterizing the quasi-mechanical 
behavior of the system that remains when the housekeeping heat is ignored in the case of an 
infinitesimally slow operation, and the deviation from this behavior in the case of a finitely 
fast operation would be easily characterized. In this section, we find that for some types of 
systems, the idea of distinguishing between different types of heat does indeed facilitate the 
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construction of a thermodynamic potential. It is thus seen that the intuitively appealing 
approach proposed by Oono and Paniconi is useful. However, as shown in Appendix [Dj for 
d2J), the component of the heat in the non-equilibrium case that is analogous to the total 
heat in the equilibrium case is not the extra heat that they define but the non-uniform heat, 
Q non , defined in the previous section. In general, these quantities are distinct for the system 
studied here, due to the presence of a spatially uniform component of the extra heat (see 
Appendix [D]). Next, it is shown that, unlike in the equilibrium case, the deviation from 
quasi-mechanical behavior of the system that appears for a finitely fast operation is not 
easily characterized. Finally, it is shown that, again unlike in the equilibrium case, despite 
the fact that infinitesimally slow operations are reversible (if we subtract the uniform heat), 
in general they are not path independent. For this reason, although it is possible to define 
a thermodynamic potential given a particular path in parameter space, the potentials cor- 
responding to different paths will differ, and hence the thermodynamic potential is not a 
state function. We thus conclude that the usefulness of a formalism based on a thermody- 
namic potential - without the introduction of a drastically different manner of thinking - is 
doubtful. 

B. Perturbative solution to equation of motion 

In the following, we consider an ensemble of experiments described by (j2J) that are carried 
out under the following conditions. First, the system is prepared by keeping a fixed at some 
initial value ai\ over the time interval i G (— oo,i;), for some finite value t\. Then, a is 
varied in some manner over the interval t G [ii, if]. (We assume that a(t) is analytic for all 
t G (ii, if).) Finally, a is held fixed again to some value af for all t > if, and the system is 
allowed to relax to some new steady state. Thus, the operation carried out by changing a 
induces a transition between the steady states corresponding to an and af. We would like to 
derive a solution p(x, i) that describes the system for all i G [ii, if], but because the nature of 
the experiment implies that there will be some nonanalytic behavior at i = ii, the solution 
for times close to ii will depend in a complicated manner on these initial conditions. For 
this reason, obtaining a solution that is valid for this entire time interval is not possible. 
However, because p(x, i) represents an ensemble of random walks, it is expected that as 
the time increases, all dependence on the initial conditions (i.e., the nonanalytic behavior) 
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will be lost [13]. Thus, we conjecture that there exists a unique form to which p(x,t) will 
converge in the limit of large i — ij. We expect that this solution will be simple, in the sense 
that the complicated dependence on the initial, non-analytic behavior will have dissipated 
away, and that it will be universal, in the sense that it is the form to which p(x, i) converges 
for all p(x,ti). In the parlance of renormalization group (RG) theory, this form represents 
an RG fixed point, and it is often referred to as the 'scaling form' solution, describing the 
'scaling' or 'intermediate asymptotic' regime. In the context of center manifold theory, this 
universal form represents the center manifold itself. In the following, we derive a solution 
of this type. Of course, in order for such a solution to be realized in an experiment of the 
type considered here, it is necessary that if be sufficiently large. We assume this to be the 
case. Actually, in the following, we assume that this scaling regime solution represents the 
behavior of the system over the entire interval [ii, if], ignoring the transient behavior entirely. 
While this introduces an error into several of the results derived here (for example, in the 
total work done through F over this interval), if we consider only very long operations, the 
contribution of the transient, and hence the error in our results, should be negligible. In 
fact, we estimate the error introduced by ignoring the transient when computing quantities 
such as the total work and the total heat in Appendix [Bl Then, we use that result in Section 
IIII Bl and Appendix [D] to show that the contribution of the transient to each of the quantities 
computed there is negligible. 

Throughout this paper, the concept of the timescale of the variation of a plays an 
important role. For this reason, it is convenient to introduce a dimensionless parame- 
ter, p, whose inverse characterizes this timescale, and we write a as a(pt). We also as- 
sume that the solution to (j2J) can be written as an expansion in powers of \i in the form 
p(x,t) = po(x,t) + ppi(x,t) + p 2 p2(x,t) -\ . Here, the quantities p n (x,t) are O(p ) func- 
tions. In general, such a solution can be obtained by substituting this form into the equation 
of motion and solving the resulting equations order by order in p, beginning with the O(p ) 
equation. Certainly, it is not always the case that the expansion obtained in this manner 
converges, and, in particular, it is generally not possible to write such a solution for the tran- 
sient regime. However, for sufficiently small p, this procedure should yield a valid solution 
in the intermediate asymptotic regime [141 ] . 

In Appendix |AJ we explicitly construct a solution to ([2]). In this calculation, both p and 
a are regarded as small quantities, and we seek a solution to ([2]) perturbatively in both. (For 
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convenience, we write a (/it) = ba(pt) and regard b as a small quantity. The calculation is 
then carried out as a formal perturbative expansion in p and b.) With the various conditions 
described above, and employing the perturbative method demonstrated in Appendix IA~| 
such a solution can be constructed straightforwardly. However, the computation rapidly 
becomes complicated as the orders in p and b increase, and for this reason, we carry out this 
perturbative calculation only to first order in both of these quantities. Also, for simplicity, 
we consider the case in which the potential takes the form V(x; a) = acos(kx). 

With the above assumptions, from the computation given in Appendix [A] to O^p ,^), 
we obtain the following: 

p ( -°\x,t) = \l + ba(pt) (cr° cos(A;s) + <x° sin(fcx))] c . (10) 

Here we have = —k 2 T/8 and a°_ = —kf/6, with 9 = k 2 T 2 + f 2 . As noted in the previous 
section, cq is the average particle density. We also note here that throughout the paper, we 
write as p( n \x,t) an approximate form of p(x,t) valid to 0(p n ). 

Before proceeding to the next order in p, we point out that p^(x,t) depends on time 
only through a(pt) and that, in fact, we have the identity p(°'(x,t) = p ss (x; a(pt)), where 
p ss (x] cx(pt)) is the steady state solution corresponding to a = a(pt). This is important in 
the analysis carried out below. 

Then, as shown in Appendix |A], at 0(p l ), we have the contribution 

Pi(x, t) = ba'(pt)^ (crj_ cos{kx) + a]_ sin(A;x)) c , (11) 



where a' = da/d{pt), and we have a\ = {k 2 T 2 - f 2 )/6 2 and o\ = 2kTf/6 2 . 

Combining the above results, we obtain the following form for p(x,t), valid to 0(p l ,b l ): 

p^(x, t) = cq jl + (t\ol + 7cr+<i cos(A;x) + a°_ a + ^o x _a sin(fcr)j . (12) 



C. Transitions between steady states: work, thermodynamic potential and en- 
tropy 

1. Overview 

Here, we briefly describe a formalism analogous to that employed in the study of equi- 
librium systems that can be developed for the system studied here. This formalism is then 
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used to study the behavior of various thermodynamic quantities in the type of experiments 
described above. 

In the following, we show that the steady state solutions of ([2]) are characterized by a 
thermodynamic potential, $, from which the total work done by means of F in the case of 
an infinitesimally slow operation can be derived. We also show that the quantity playing the 
role of the entropy in this potential is not the equilibrium entropy. Then, we demonstrate 
that the change of this generalized entropy in an infinitesimally slow operation is equal to a 
particular type of heat absorbed by the system (namely, Q non ) divided by the temperature. 
Next, we find that for a finitely fast operation, depending on the values of /, T and a, the 
inequality in the second- law- like relation characterizing this system can be reversed. It is 
thus seen that the deviation from quasi-mechanical behavior of the system in a finitely fast 
operation causing a transition between non-equilibrium steady states cannot be characterized 
in a simple manner, unlike in the case of transitions between equilibrium states. Finally, 
we show that if the adjustable parameter possesses multiple degrees of freedom, even in 
the case of infinitesimally slow operations (and with an entirely isothermal operation), the 
amount of work done in going between specified initial and final values in parameter space 
is in general path dependent. From these results, we conclude that the concepts of the 
thermodynamic potential and entropy when employed in a straightforward generalization 
of the equilibrium formalism are of limited use in characterizing the behavior of the system 
studied here. Apparently, a meaningful application of these concepts to the investigation of 
non-equilibrium steady states will require the development of a radically novel approach. 



2. Thermodynamic quantities 

Here we introduce generalized thermodynamic quantities defined in such a manner to 
obtain a formalism analogous to that of equilibrium thermodynamics 15]. 

Let us begin by reconsidering (J7J). Integrating this over the entire process under consid- 
eration, we obtain the following: 

AU = W F - £ dt J dxFj Qon . (13) 



Now, let us consider the limit of a quasi-static operation. Then we have J t tf dtwp{t) 
'iri 

oa 1 



J dx j" f da^p ss (x; a). This quantity, which we call Wp, is obviously independent of \x and 
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is reversible. In other words, it depends only on ct\ and at{. For this reason, below we often 
refer to this quantity as the "reversible work." Then, because AU also depends only on ci\ 
and «f, the quantity lim^ J? f dt J dxFj non is a state function, and it is natural to define 
the thermodynamic potential $(a) through the relation 

A$ = AU + lim / ' dt [ dxFj non . (14) 

M-*0 A j 

In fact, if we wish for our thermodynamic potential to play the same role as that in the 
equilibrium theory - i.e., the quantity whose change represents the reversible work done on 
the system through the work coordinates - then this is the unique choice. It should also be 
noted here that for fixed a, it is indeed the steady state solution that minimizes $, and hence 
this quantity truly is analogous to the equilibrium free energy. This can be demonstrated 
by considering a variation of $ and showing that the p for which this variation vanishes is 
also that for which the relation j = j holds. This calculation is made somewhat non-trivial 
by the fact that $ contains j non . For this reason, when carrying out the variation, it is 
necessary to include the virtual variation of the current corresponding to a virtual variation 
of the probability distribution. 

Now, as shown in Appendix [Cl in the case of a quasi-static operation, the change in the 
entropy of the system (defined as S = — / dxp(x) In p(x)) is given by 



AS = T- 1 lim [ tf dt I dx 

m^o J ti 



-non ■ 

J J 771 'I 

7 F] 

P 



(15) 



rt{ f 7 'non ■ 

A<3> = AU - TAS + 7 lim / dt dx- — - . (16) 

V+oA Jo v ' 



Then, combining this with (1141) . we obtain the following: 

r t{ r ,'i)(Ul 

Hi J P 

Next, note that the quantity jj/p takes the form of a frictional force, and thus 
7 // ; f dt J dx^p- can be regarded as a type of frictional work. Then, because AS" itself 
is obviously reversible, the quantity 7 lim^o /// dt J dx^y 1 represents a reversible frictional 
work that characterizes a quasi-static transition between two non-equilibrium steady states. 
Considering the form of ffl6|) . it is natural to define the generalized entropy, E, through 
the relation AS = AS — ^T~ l lim M ^ dt J dxi—i-. For a system described by (J2]), in the 
case / 7^ 0, the quantity ^T~ l lim^o ft' dt J dx^p- is generally non-zero, and hence the 
generalized entropy appearing in the thermodynamic potential differs from S. In the system 
considered here, the difference between S and £ appears at 0(b 4 ), vanishing at lowest order 
[i.e. 0(b% 
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Then, representing the value of <5 non in the quasi-static limit by Qs° n , an d comparing 
(TH|) and ffT6]) . we obtain the generalized Clausius relation 

AS = Q™/T . (17) 

Below, we often refer to Qs° n as the "reversible heat." 

It is important to note the difference between Q non appearing here and the so-called 
extra heat defined in In that work, it is conjectured that for an operation through 
which a system experiences a transition from one non-equilibrium steady state to another, 
the change in the entropy is greater than or equal Q ex /T, where Q ex is the extra heat, with 
equality in the case of a quasi-static operation. (For the definition of the extra heat, see 
Appendix [D]) Here it is noted that for the system considered here, Q ex and Q non are distinct 
quantities both for quasi-static and non-quasi-static operations. Further, for this system, 
the conjecture made in Q| does not hold. (For details, see Appendix [D]) However, it should 
be noted that the manner of thinking presented in [5(, in which the heat is divided into 
different types, is quite useful in the above analysis. 



3. Case of finite \i 



We have found that in the case of a quasi-static operation, the system considered here 
can be described using a formalism similar to that of an equilibrium system, with £ playing 
the role of the entropy, and Q non playing the role of the heat. We now consider the case of 
finite \i. 

Using the (^(/i 1 ,^ 1 ) form of p(x,t) derived above, the change in energy of the system as 
a result of the operation is obtained as 

k 2 T, 



AU 



20 



•[of - aJcoL . 



Then, from the relation Wf = f£ dtp^, we derive the following: 



k 2 T 



[of - of] + 7 



k 2 T 2 - f 2 



dta 



CqL. 



(18) 



(19) 



4:0 11 1 29 2 Jt, 

Let us assume here that tf — ti is C(/x _1 ), so that the second term above is generically C(/i). 
Next, combining ( TlBl) and ( fl9l) and employing the definition of Q non , we immediately obtain 

k T r O n. 



Q 1 



46 



k 2 T 2_ f 2 tf r 

or - nr —7 — J din' 



29 2 



CqL. 



(20) 
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Then, noting that the first term here (i.e., that independent of /i) is Qs° n , and using (ITTj) . 
we arrive at the following relation for AS, valid to 0(/j}, b 2 ): 



It is thus found that, to this order in \x and b, if / > kT, we have AS < Q non /T. Then, 
although we have not explicitly computed the 0(y) term in AS to higher order in b, through 
a simple calculation we have found that the change in sign of this term does not generally 
take place at / = kT. It is thus concluded that the sign of this 0(/jl) term depends in some 
non-trivial manner on T, / and a. Hence, it is seen that the relation between AS and Q non 
for finite \i is much more complicated than that between the change of the entropy and the 
transfer of heat in the equilibrium expressed by the second law. The implication 

here is that the amount of work that can be extracted from the system through the work 
coordinates in a transition between two steady states is not always maximized by a quasi- 
static operation. 

Before moving on, we note that, as seen from the argument given in Appendix [B] (and 
the fact that a is O(fi)), the contribution to Wp from the transient behavior near t — t\ is 
C{fi 2 ). Thus, (USD and ([20]) are indeed correct to OQjt). 

4- Case of a two-component potential 

To this point, for simplicity, we have considered a potential V that contains a single 
adjustable macroscopic parameter. Here, however, we briefly examine the case in which there 
are two such parameters. We do this to demonstrate that although quasi-static operations 
carried out on the type of systems studied here are reversible, they are not generally path- 
independent. 

Here, we consider (J2]) with V(x;ai,a 2 ) = a% cos(kx) + a 2 cos(2/cx). Then, we study 
operations in which both a% and a 2 are varied. We assume that we can write otj(t) = ba,j(t) 
for j = 1,2, where b is a small quantity and a,j(t) is 0(1) throughout these operations. In 
this case, it is easily found that, to order b 2 , the steady state solution is given by 






4k 2 T 



k 2 (2k 2 T 2 + f 2 ) 



a x cos(2A;x) 



+ 
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kf 
- T «i- 



6k 3 fT 



ee 



-OL\OL 2 



sin(kx) 



+ 



2kf 



a 2 + 



3k 3 fT 



-a-. 



sin(2/ca;) > c , 



(22) 



where 9 = Ak 2 T 2 + f 2 . Then, using this form, we compute the work done by the external 
agent in two processes, one in which first a\ is changed from its initial value, a\, to its final 
value, a[, and then a 2 is changed from a 2 to a f 2 , and one in which this order is reversed. In 
the first case, the total work, Wip, is given by 

f , f** 1 , / \sdV(x;ai,ao) f , f" 2 , / f ,dV(x;a[,a 2 ) 
W lt2 = J dx J . daip ss (x;ai,a 2 ) — h J dx J _ da 2 p ss (a:; a 2 ; ^ , 

(23) 

while in the second case, the total work, W 2: i : is given by 



W 2 ,i = I dx [ 2 da 2 p ss (x; a\, a 2 ) 

J Jal 2 

Simple calculations yield 

W 1:2 - W 2A 



dV(x; a\, a 2 ) 
da 2 



+ 



hi: 



{ .dV(x] cki, a 2 ) 



dcti 



3k 2 / 2 
99 



(24) 



(25) 



In the equilibrium case, this difference vanishes, but for non-zero /, it does not. It is thus 
seen that for the system considered here, the work done in going from (a\,a 2 ) to (a[,a f 2 ), 
even for quasi-static operations, depends on the path taken between them. Thus, although 
for a given path in 5-space, a quasi-static operation is reversible, and hence we can define 
a thermodynamic potential and thus a generalized entropy for that path, this potential and 
this entropy are path dependent. Therefore, they are not state functions. 



D. Conclusion regarding generalization of the equilibrium formalism 

The importance of the entropy in the study of equilibrium systems is due to the simplicity 
of its properties, as described by the second law. This simplicity allows us to define a 
thermodynamic potential that is useful because, first, it is a state function, and hence the 
work done by the system in all quasi-static operations connecting two equilibrium states 
is uniquely given by the difference between the values of the potential in these states, and, 
second, the work done by the system in a non-quasi-static operation connecting the same two 
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states is always less than this value. By contrast, for the type of system considered in this 
paper, although we can define a thermodynamic potential analogous to that for equilibrium 
systems, such a potential possesses neither of these properties. 

The results of this paper lead us to conjecture that the type of phenomena described by the 
equilibrium theory, i.e., the interplay between thermal and mechanical energy in operations 
connecting steady states, cannot be described systematically in the non-equilibrium case. 
This would seem to imply that the entropy and the thermodynamic potential will not play 
central roles in a general phenomenological theory of non-equilibrium steady states. We are 
thus led to seek a theoretical framework for such states based on some other quantities. 



IV. CONCLUSION 



The broad goal of thermodynamics is to construct descriptions of macroscopic behavior 
in terms of macroscopic observables. The problem encountered in this pursuit is that it 
is generally difficult within a purely macroscopic description to account for the effect that 
microscopic degrees of freedom have on the macroscopic observables. In the case of a system 
in equilibrium, very large numbers of microscopic degrees of freedom act collectively in such 
a way that they can be treated as a small number of macroscopic degrees of freedom. For 
this reason, when a system undergoes an infinitesimally slow operation, during which it is 
always infinitesimally close to an equilibrium state, a simple, quasi-mechanical framework 
based on a thermodynamic potential expressed entirely in terms of macroscopic state vari- 
ables is sufficient to describe the total amount of thermal energy converted into mechanical 
energy in the transition between some initial and final states. Then, considering the set of 
all operations connecting these states, the amount of mechanical energy thus obtained is 
maximal in this case of an infinitesimally slow operation. These simple properties form the 
basis of the thermodynamic theory of equilibrium states. In this paper, we have shown how 
the attempt to formulate an analogous theory of non-equilibrium steady states - namely, 
a quasi-mechanical model describing the interplay between thermal and mechanical forms 
of energy during externally applied operations - meets with difficulty in the case of a par- 
ticular model. As discussed in the previous section, the difficulty encountered here results 
from the complicated nature of the work done by the system in operations (even quasi-static 
operations) connecting non-equilibrium steady states. 
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As stated above, the fundamental problem in constructing any type of thermodynamic 
formalism is to determine how to account for the effect of microscopic degrees of freedom on 
macroscopic behavior through expressions involving macroscopic observables. Certainly, for 
any given system, there are limitations on the types of behavior that can be described simply 
in such a phenomenological manner. Thus, in the attempt to construct a phenomenological 
theory for a given class of systems, it is of fundamental importance to ascertain the types 
of behavior for which simple phenomenological descriptions are feasible. The results of the 
present work suggest that the conversion of heat into mechanical energy, which is the focus 
of the thermodynamic theory of equilibrium states, may be of a type for which a general 
phenomenological description is unfeasible in the case of non-equilibrium steady states. This 
leads us to conclude that in order to construct a phenomenological theory of non-equilibrium 
steady states, we will need radically new concepts involving novel quantities. It is our belief 
that the search for non-equilibrium theories should now be focused on finding such concepts 
and quantities, rather than attempting to extrapolate from the equilibrium theory. 
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APPENDIX A: PERTURB ATIVE SOLUTION TO EQUATION OF MOTION 

In this section we derive the 0(fi l ,b l ) solution to (j2J) using a renormalization group 
(RG) method. The formulation of RG employed here is presented in [17|. This formulation 
is designed to treat differential equations in which there appear quantities that exhibit 
slow variation with respect to the independent variables. In the simplest situation, such 
an equation describes a system possessing some kind of slowly varying temporal and/or 
spatial inhomogeneity, and this is represented by slowly varying explicit functions of time 
and/or space contained in the equation. With this method, the system is first treated 
locally by expanding the slowly varying quantities in the equation about some fixed values 
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of the independent variables and then deriving a locally valid solution to the resulting local 
equation. Then, the RG procedure is used to obtain a globally valid solution by appropriately 
connecting all such local solutions. 

In the present case, the slowly varying quantity is a(fit) = ba(pt). Thus, as the first step 
in solving we expand a about some arbitrary value of time, t - Because we seek the 
0(p}) solution to the original equation of motion, we retain only terms in the local equation 
up to 0{p}). Thus, we consider the following: 

• (i) f d 2 d 

7P (x,t) = <T—-[f + b(a(/ito)+iJ l (t-to)a(iJ l t ))ksm(kx)] — 

-b (a(fito) + (i(t - t )a') k 2 cos(A;x)} p {1) (x, t) . (Al) 

Here, we have a' = da/d(pt). Also note that throughout this section, the tilde indicates 
that the quantity in question is defined only locally, and a superscript (n) indicates that it 
is valid to 0{p n ). 

Next, we solve the local equation flAlj) order by order in /i, explicitly constructing an 
0(p l ) solution of the form p^>(x,t) = p (x,t) + p,pi(x,t). 

First, to obtain po(x,t), we keep only the O(pP) terms in ( I All) . This yields the equation 

• f d 2 d ) 

7P (x, t) = I T—— — [f + ba(pt )k sm(kx)] — ba(pt )k 2 cos(kx) > Po(x, t) . (A2) 

[ ox 2 ' ox J 

Now, because we seek solutions to (j2J) that are near steady state solutions [la ], we are 
interested in the solution to (IA20 satisfying p Q (x, t) = 0. Using this, we obtain the following 
0{b l ) solution to this equation: 

Po(x, t) = Co 1 + ba(pt ) ^cr° cos(A;a;) + a°_ sin(A;a;)^ . (A3) 

The quantities c° and a°_ appearing here are given in Section 3. The function in (1A3j) 
represents a solution valid to 0{pP,b 1 ) in the neighborhood of t = t . Then, to obtain the 
global Oi^pP.b 1 ) solution, we merely set t = t in (1A3|) . This gives the lowest-order solution 
presented in Section 3, 

p(°)(x, t) = d 1 + ba(pt) (a° + cos(kx) + a°_ sin(fcx)) . (A4) 

The O(fjP) RG equation, obtained by retaining the O(pP) terms in the equation | fp=f — 

0, is simply = 0. As stated in Section 3, if we replace a(pt) by some fixed value a, the 
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solution given in (IA4I) represents the steady state solution to the original equation of motion 
at this value of a. 

Next, we derive pi(x,t). This is done by first extracting the 0(p}) terms in (lAip and 
thereby constructing the following: 



• f d 2 d } 

7p x {x,t) = I -[/ + ba(fd )k sm(kx)] — - ba(pt )k 2 cos(kx) \ pi{x,t) 



- y>(t - t )a'(p,t 
The Oip 1 ) solution to this equation is given by 



d 

k sin(A;x) — — \- k 2 cos(kx) 
ox 



po(x,t) . 



(A5) 



Pi(x, t) = co'yd(pto) | b cr+ cos(A;x) + a\ sin(kx) + (t — t ) —ba^ cos(kx) + a°_ sin(A;a;) | . 

(A6) 

We have thus derived the local solution valid to 0{p l , b 1 ), p^(x, t) = po(x, t) + pp~i(x, t). 
Then, setting £ — t in this form, we obtain the global solution valid to the same order: 



p( 1 )(x,t) = c {l + ba(pt) 



cr° cos(kx) + a°_ sin (kx 
+p'yba'(pt) cr^ cos(A;x) + cri sin(A;x) | . 



(A7) 



At this order, the RG equation is given by ^z^~~\t =t = 0. Solving this, we obtain 6c{t) 
a(t), and, as in the O(pP) case, it is trivial [19|. 

The following form of p^'(x,t) is more transparent: 



p^ (x, t) — Cq 1 1 + 0"° a + 7crJ_d cos(kx) + 



a°_a + ^a x _a 



sin 



(kx)} . 



(A8) 



The form of this solution represents the 0(p},b 1 ) approximation to the RG fixed point (or 
center manifold) of ([2]). The slow motion contained within this form, coming from the time 
dependence of a and a, represents the dynamics on this fixed point (or manifold). 



APPENDIX B: ESTIMATION OF THE CONTRIBUTION OF TRANSIENT 
REGIMES 

As noted in Section fill Bl the solution derived there describes the system in the 'scaling' 
regime, after transient behavior has disappeared. However, in several places in this paper, we 
calculate quantities by integrating over the time interval [t;,tf], assuming this solution to be 
valid for all such times. The fact that we ignore the transient behavior in these calculations 
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introduces an error. Here we present an argument from which the size of this error can be 
estimated. 

For the type of experiments considered here, there are two intervals during which transient 
behavior will appear, one for i slightly greater than i i; as p(x,t) relaxes to the form derived 
in Section fill and one for i slightly greater than if, as p(x,t) relaxes to the final steady 
state. First we consider the behavior for t near ij. 

At i = ij, the difference, 8p(x,t), between the actual p(x,t) and that given by (TT21) is 
O(p). (For the purpose of the present discussion, let us refer to the latter as p ac ai(x,t).) 
We seek to describe the time evolution of Sp(x,t). This can be done by employing the 
computational technique demonstrated in Appendix [A3 First, we expand ([2]) locally in time 
about some i near ii. Then, to O(p), the (local) equation of motion for 6p(x,t) is 

d5p(x, t) 



7" 



Ot 



^d 2 , . y ^ d dF(x;a(fj,to)) 
T ^- {f + F{X] a( ^ o))) Yx Yx 



Sp(x,t). (Bl) 



Now, with the assumption that p sca i(^, t) represents a stable fixed point of the time evolution 
of (j2J), one eigenfunction of this equation will have vanishing eigenvalue, and the rest will 
have negative eigenvalues. That with eigenvalue corresponds to p aca i(x,i) itself. Then, as 
( 1B1I) contains only 0(1) quantities, all such negative eigenvalues will be 0(1). Thus, when 
viewed locally in time, each mode (other than that corresponding to p SC ai{x,t)) will exhibit 
simple exponential decay with an 0(1) decay constant. Let us consider an arbitrary such 
mode and refer to its decay constant as A. Then, "renormalizing" the local solution for 
this mode (i.e., applying the RG equation and setting i = i) to properly connect the local 



behavior corresponding to each time i (see [17| for detailed discussion), we obtain solutions 



of the form Oexp[— X(pt)t] for each decaying mode. (Thus, the decay constant A becomes 
a slowly varying function of time. This is due to the fact that the local eigenvalue, A, will 
contain a(pt ), and hence depend on the time t about which the equation of motion is 
expanded.) Thus, each mode will decay exponentially with a slowly varying [but always 
0(1)] time "constant." (This exponential decay represents the convergence of p(x,t) to the 
center manifold, constituted by p sca x(x,t). The slow variation in time of its decay constant 
is due to the slow motion on the center manifold.) Thus, we have fast exponential decay of 
5p(x, i) to zero, with the speed of this decay varying slowly in time. Therefore, any integral 
/ dx // f dtg(x,t)5p(x,t), where g(x,t) is an arbitrary 0(1) function, will be O(p). 

The situation regarding the transient after if is similar, but slightly simpler. In that case, 
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each mode (except that corresponding to the center manifold, which in this case corresponds 
to p ss (x;cx{)) will exhibit simple exponential decay with an 0(1) decay constant that is 
actually constant. 



APPENDIX C: DERIVATION OF (fISjt 

Here we give the simple computations yielding (1151) . 

Consider an arbitrary process (which, for example, may result from an externally applied 
operation) taking place in the system described by (j2J) over some time interval [ii,tf]. For 
such a process, we wish to find a relation between the change in the Shannon entropy, 
S = — J p(x,t) log p(x,t)dx, and experimentally measurable quantities. In this process, the 
change in entropy is given by 

rtf 

Obviously, the spatial integral of the second term vanishes. Thus, with the relation p(x, t) 
— V • j(x, t), this becomes 



AS = -Jdt J [p(x,t)logp(x,t) + p(x,t))dx . (CI) 



AS = J 1 dt J \og[p(x, t)} V • j(x, t)dx . (C2) 

Then, using integration by parts, and the fact that we stipulate periodic boundary condi- 
tions, we obtain 

AS = - jf dt J j(x, t) ■ V hg[p(x, t))dx . (C3) 
Next, using the relation 

j(x, t) = -r l TVp{x : t) + 7 -^(x, t)p(x, t) (C4) 

and writing j(x,t) as j(x,t) = j(t) + j non (x,t), we obtain the following: 

AS = D- 1 \ h dt [ dxj non (x, t) O^ii + JSL _ ^Fix, t) dx . (C5) 
Jti J l p{x,t) p{%,t) 

Then, assuming that in the p — > limit, j non is O(p), we find 

dx . (C6) 



AS = T- 1 lim f 1 ' dt f dx 

M^O J t . J 



This is the relation given in f 1 1 5 p . With AS as defined in the main text, (1061) is equivalent 
to TAS = Q™ n = - lim^o $ dt J dxF(x, t)j non (x, t). 
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APPENDIX D: Q non AND Q c 



In this appendix, we briefly compare the quantities Q non and Q ex and show why they 
differ for the system studied here. 

Following Oono and Paniconi, the housekeeping heat for an operation of the type con- 
sidered in this paper is defined as the total amount of heat that would be transferred 
from the heat bath if at each time t G [ti, tf], the system were in the steady state char- 
acterized by a(t). More precisely, we have Q UK = // f dtq ss [a(t)], where g ss [a(t)] is the 
rate of heat production in the steady state corresponding to a = a(t). Then, the extra 
heat is defined as Q cx = Q — Q nK . Clearly, from these definitions, we have the relation 
Q cx = — // f dt J dx[F(x;a(t)) + f]j ex (x,t), where the extra current, j ex (x,t), is defined as 
j ex (x,t) = j(x,t) — j ss (a(t)). With a simple calculation, using the 0(ij},b 2 ) solution to (T2J) 
(which is not given explicitly here) and the relation ([3]), we find, to ©(/i 1 , b 2 ), 



f x (x, t)=a{ [(fa l + - kTal) cos(kx) + {kTa\ + fa l _) s\Yi(kx) 

(fal + - 2kTa\_ -) cos(2A;s) + {2kTa\ + + fa\_ + — ±) sin(2A;a;) + — - 



+ a 



Here, the quantities <j\ + and a\_ are the ^(/i 1 ,^ 2 ) coefficients of the terms cos(2/ca;) and 
sin(2/cx) in the solution p(x,t). Because they are somewhat complicated, and the terms in 
which they appear in fIDll) give no contribution to Q ex , we do not present them here. 

Note that in the above expression for j ex , we have the spatially uniform component 
^aaka^_CQ. We refer to this as the "uniform extra current," and write it j ex (t). Now, 
substituting the form in (1D1I) into the above equation for Q ex , we obtain the following 
0(fi°) expression for this quantity, which we refer to as Ql 

T 



~\cx. 
' ss ■ 



at 



a-. 



L . 



(D2) 



This expression is valid to 0(b 2 ). 

Next, note that j non (x, t) = j(x, t) - j(t) is given by j non (x, t) = j cx - f*(t). With this, 
we find, to 0{b 2 ), 

(D3) 



n non „ ^ f^o 2 i 2 
Qss = -co^ [0+ + v- 



a { — oij 



A straightforward computation shows that this is indeed equal to TAS. (Note that to this 
order in b, AS and AS are identical. Their difference appears at (9(6 4 ).) 
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It is thus seen that Q non and Q ex differ as a result of the presence of the uniform ex- 
tra current. Also, it should be noted that both of these quantities are readily measured 
experimentally, and hence they can be directly compared. 

Intuitively, it is reasonable that it would be Q non and not Q ex that is closely related to 
the change in the entropy, as the description of the system (i.e. p) is obviously unchanged 
by any uniform current. In other words, it is the heat generated in the rearrangement of 
the probability distribution necessary to change it from p ss (x;ai) to p ss (x;af) that should 
be related to the change in entropy, and this heat is Q non . 

It is important to note here that we have ignored the contributions of the transient 
behavior to Q non and Q ex for both t slightly greater than t\ and slightly greater than tf. 
However, from the argument given in Appendix [B], it is seen that these contributions are 
no greater than O(p). Next, note that <3s° n can also be obtained from p ss (x;a(t)) alone, 
without deriving j non . This is seen from the relation Qg S on = AU — Wp, and noting that 
Wp = J dx /° f dap ss (x; a) dV ^ a °^ , as mentioned in the main text. Using this method of 
calculating Qg° a , it is seen (as discussed in IIII Bl) that the contribution of the transient to 
Q non is actually only 0(p 2 ). 

Finally, we point out that the result found here appears to be inconsistent with that 
obtained in [20|. The reason for this is that the definition of the extra heat there (see 
Eq. (16) of that work) is inconsistent with that studied here. It should be noted that the 



extra heat used in 



2Gj would be quite difficult to measure in all but the simplest systems. 



APPENDIX E: VALIDITY OF THE LANGEVIN AND SMOLUCHOWSKI 
EQUATIONS 

Let us now consider the validity of the Smoluchowski equation, (j2j). Because this equation 
can be derived quite generally from the Langevin equation (pQ), it is sufficient to consider 
the validity of the latter. 

In this appendix, we discuss the validity of the Langevin equation taking the form 

Mx(t) = -ji(t) + T(x{t)\ a(t)) + £(t) , (El) 

where, M is the mass of the Brownian particle. In the standard treatment, we have 7 = 6ttRt] 
(where 77 is the viscosity and R is the radius of the Brownian particle), and the intensity 
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of the stochastic force is given by K = 27T, as determined by the fluctuation-dissipation 
relation. 

The above equation is valid in application only to systems that possess two distinct types 
of motion, microscopic and macroscopic, whose characteristic timescales are greatly sepa- 
rated. For the present purposes, the relevant timescale of the microscopic motion, r micro , 
is the average time between collisions of the heat bath particles with the Brownian parti- 
cle. Then, there are two relevant timescales of the macroscopic motion, namely, the times 
required for the position and the velocity of the Brownian particle to change by macroscopi- 
cally measurable amounts, which, of course, depend on the spatial and temporal resolutions 
of the observation. Let us refer to these as r macro 1 and r macro2 . The main condition nec- 
essary for the dynamics of the Brownian particle to be describable by a Langevin equation 
of the form appearing in flEll) is that r macro 1 and r macro 2 be sufficiently longer than r micro 
that the dynamics of the heat bath particles can be clearly separated into fast, stochastic 
motion and slow, systematic motion, with the statistics of the fast motion being completely 
independent of the slow motion and the slow motion determined entirely by the motion of 
the Brownian particle. If this is the case, then there should be a fourth timescale, Ti oca i eq , 
satisfying r micro <C r loca i cq <C r macro 1 , r macro 2 , on which the stochastic behavior of the heat 
bath particles realizes a stationary distribution, which at any time t depends only on the po- 
sition and velocity of the Brownian particle at this time, x(t) and x(t), the global properties 
of the heat bath (e.g., the temperature, the average particle concentration, and the mass of 
the heat bath particles) and the size and shape of the Brownian particle. If there exists no 
such time scale, then the statistics of the force exerted by the heat bath on the particle at 
any time will depend in some non-trivial manner on the history of the particle's motion, its 
interaction with the heat bath will depend non-linearly on its velocity, the stochastic force 
it experiences will be non-Gaussian, and in general, formulating a meaningful description 
of its motion will be hopeless. Now, with the simplest considerations, we are able to derive 
the following set of conditions which must be met in order for such a timescale to exist: x 
must be much smaller than both (i?/Z) 1//2 c and c SOU nd (where I is the mean free path of the 
heat bath particles, c is the rms velocity of the heat bath particles, and c soun d is the sound 
velocity in the heat bath), and the timescale over which x varies must be much longer than 
both R/c and Z/ c sound- 

Next, we consider the conditions on the timescale of the description, f, that must be 
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met in order for the Langevin equation to be valid. First, we note that there are several 
other important timescales that characterize the system in addition to those cited above. 
First, there is the timescale on which the Brownian particle experiences a set of collisions 
that are representative of the stationary distribution of the heat bath particles. It should 
be the case that this timescale and r loca i eq are of the same order (although, certainly, the 
former must be longer than the latter), and for our purposes, they can be regarded as the 
same. Next, there is the correlation time of the Brownian particle's velocity, r corr . Then, 
there is the timescale over which the force J r (x(t);a(t)) changes, 7>. The first condition 
on f is that it must satisfy f ^> ri oca i eq . If this is not the case, then there will be no well- 
defined friction constant nor intensity of the stochastic force 21] . Second, it must be the 
case that f <C T macrol , in order for the trajectory of the particle to be continuous. That 
we can choose a f that satisfies these two conditions follows from the main condition given 
above. Third, it must be the case that f <C tj?, in order for the force in the equation to be 
well-defined. Of course, this third condition follows from the second as long as T can be 
regarded as constant on lengthscales smaller than the resolution of the observation and a 
can be regarded as constant on timescales shorter than f . 

Finally, assuming that the above conditions are all satisfied, and the Langevin equation 
provides a proper description of the system's dynamics, then in order for these dynamics to 
be overdamped, it must be the case that r corr <C t>. (Note that here, we can regard r corr as 
M/j.) This implies the relation i rms > |5J [a^g^ + x ■ VJ r (x 



where x rrn <, is the root- 



mean-square velocity of the Brownian particle, as measured over the timescale r corr . This 
condition is sufficient for an equation of the form (JTJ to provide a valid description of the 
dynamics. However, for this form with a delta-function correlated noise to be valid, it is also 
necessary that we have f ^> r corr . Then, in order for the position of the particle to be well- 
defined at all times with such a description, it is necessary that we have |x(t)|r corr <C Ax, 
where Ax is spatial resolution of the experimental measurements. 
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